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FOREWORD 


The  motivation  for  this  paper  emanated  from  a problem  formulated  by 

W.  J.  Schultis1 2  and  subsequently  addressed  by  C.  L.  Dym  and  R.  E. 

2 

Schwartz.  The  work  was  supported  by  the  Institute  for  Defense 
Analyses . 

The  author  is  indebted  to  R.  E.  Schwartz  for  a strengthening  of 
the  original  Theorem  11  and  for  suggesting  the  result  contained  in 
Theorem  12 . 
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ABSTRACT 


The  problem  of  finding  an  optimal  integer  allocation  x = Xg, 

. xn)  for 

n 

maximizing  E f.(x.) 

i=l  1 1 


subject  to 


n 

S g,(x,  ) < m 
i=l  1 x 

x±  > 0 

is  considered.  For  g^(x^)  = x^,  a class  of  objective  functions  is 
characterized  for  which  a simple  rounding  procedure  leads  from  an 
optimal  continuous  solution  to  an  optimal  integer  solution.  The 
rounding  procedure  developed  at  IDA  by  C.  L.  Dym  and  R.  E.  Schwartz 
for  a targeting  allocation  problem  is  shown  to  be  a special  case  of 
a more  general  procedure. 
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ABSTRACT 


The  problem  of  finding  an  optimal  integer  allocation  x = (x  , x2, 


xn)  for 


maximizing  E f^(x^) 

subject  to 

n 

£ 9i(xi)  < m 
i=l 

xi  > 0 

is  considered.  For  g^(x^)  = x^,  a class  of  objective  functions  is 
characterized  for  which  a simple  rounding  procedure  leads  from  an 
optimal  continuous  solution  to  an  optimal  integer  solution.  The 
rounding  procedure  developed  at  IDA  by  C.  L.  Dym  and  R.  E.  Schwartz 
for  a targeting  allocation  problem  is  shown  to  be  a special  case  of 
a more  general  procedure. 


I 


INTRODUCTION 

The  optimization  technique  known  as  mathematical  programming  seeks 
the  solution  of  the  following  problem:  find  x to 

maximize  f(x) 


subject  to 

g^x)  < b.  , i = 1,  2,...,  n, 
x <=  X . 

Research  efforts  in  the  area  of  mathematical  programming  can  be 
dichotomized  by  the  generality  of  the  problem  considered.  Much  of 
the  expended  research  resources  are  devoted  to  developing  computa- 
tional algorithms  for,  or  characterizations  of,  the  solutions  to 
very  general  classes  of  such  problems.  The  generality  of  the  results 
thus  obtained  is,  without  quarrel,  useful,  elegant,  and  pedagogically 
pleasing.  However,  the  broadness  of  the  problems  treated  in  such 
generality  must,  of  necessity,  also  engender  quite  general  assump- 
tions about  their  structure.  A case  in  point  is  the  class  of  convex 
programming  problems.  Many  elegant  results  exist  for  these  problems, 
and  several  algorithms  are  particularly  efficient  for  the  computation 
of  the  optimal  solution. 

Another  line  of  research  considers  the  analysis  of  mathematical 
programs  which  are  specially  structured.  The  successful  analysis 


1.  A mathematical  program  for  maximizing  is  a convex  program 
if  (1)  f(x)  is  concave,  (2)  g.(x)  is  convex,  i=l,2,...,n,  and 
(3)  X is  a convex  set.  1 
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of  such  problems  exploits  their  structure  so  as  to  improve,  either 
theoretically  or  computationally,  upon  the  known  results  for  more 
general  problems.  It  is  this  realm  into  which  the  content  of  this 
paper  rightfully  falls. 

Before  stating  the  particular  problem  of  concern  herein,  a 
further  discursive  remark  is  in  order.  As  is  well  known,  the 
requirement  that  the  solution  to  a mathematical  program  be  integer 
typically  introduces  severe  analytical  difficulties.  There  are 
two  general  approaches  to  solving  integer  problems.  The  algorithms 
presently  described  in  the  literature  reflect  both  approaches. 

First,  the  continuous  problem  may  be  solved,  and  then  by  some  per- 
turbation of  the  continuous  solution  an  optimal  integer  solution  is 
calculated.  Rounding  the  continuous  solution  in  some  manner  is  an 
example  of  such  a perturbation.  On  the  other  hand,  the  integer 
problem  may  be  directly  approached  without  regard  for  the  under- 
lying continuous  problem.  Both  approaches  are  considered  for  the 
problem  treated  in  this  paper. 

An  important  class  of  practical  problems  requires  the  determina- 
tion of  an  allocation  of  a resource  to  a set  of  independent  alterna- 
tive uses  of  that  resource.  The  decisionmaker  wants  to  maximize  the 
return  accruing  from  the  allocation  of  the  resource.  Suppose  the 
number  of  alternative  uses  available  is  n . Let  x = (x,,  x0,...,x  ) 
be  an  allocation;  that  is,  x^  is  the  amount  of  the  resource  assigned 
to  alternative  i . Suppose  that  f . ( • ) is  the  return  function  for 
alternative  i and  g^(-)  is  the  resource  utilization  function  for 
alternative  i . Further,  let  m be  the  amount  of  the  resource 
available  to  allocate.  The  singly-constrained  allocation  problem 
is  to  find  x which  solves: 


n 

maximize  E f.(x.)  (1) 

i=l  1 1 

subject  to 

n 

I g,-(xi)£m  > (2) 

i=l 


2 


i . 


i = 1,  2,...,  n , (3) 

xi  a nonnegative  integer  , i = 1,2,...,  n . (4) 

The  problem  given  by  Eqs.  1,  2,  and  3 will  be  called  the  "con- 
tinuous problem,"  while  the  addition  of  the  constraints  given  by 
Eq.  4 yields  the  "integer  problem."  The  solution  of  either  problem 
will  be  called  "optimal."  In  Section  II  the  continuous  problem  is 
treated  in  detail.  By  making  certain  assumptions  about  the  functions 
f^( • ) and  g^(.)5  the  optimal  solution  is  characterized,  and  an 
algorithm  is  given  for  its  computation.  With  added  restrictions 
a similar  treatment  is  given  to  the  integer  problem  in  Section  III. 
Section  IV  addresses  the  interrelationship  between  the  continuous 
and  integer  problems.  Contained  in  that  section  are  results  which 
characterize  a subclass  of  problems  for  which  a naive  rounding 
procedure  yields  an  optimal  integer  solution  from  the  optimal  con- 
tinuous solution.  The  paper  concludes  with  some  examples  which  are 
presented  in  Section  V. 
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CONTINUOUS  PROBLEM 

The  following  assumptions  are  retained  throughout  this  section: 

Al:  f^( • ) and  g^(*)  are  nonnegative,  real-valued,  and 

twice  differentiable  functions  defined  on  the  nonnegative 
real  line; 

A2:  f^(-)  an<^  g±(  • ) are  strictly  increasing  functions;  and 
A3:  f^( • ) is  a strictly  concave  function,  and  g^(.)  is  a 
strictly  convex  function. 

These  assumptions  are  restrictive,  but  are  satisfied  by  certain 
real-world  problems,  some  examples  of  which  are  given  in  Section  V. 
The  assumption  of  the  nonnegativity  of  f^(.)  and  the  strictness 
requirements  in  A2  and  A3  are  not  crucial  to  the  development  in 
this  section.  These  assumptions  are  made  here  for  expository  ease 
in  the  derivation  of  the  results.  Without  loss  of  generality  it 
can  be  assumed  that  g^(0)  = 0 for  i = 1,  2,...,  n.  To  avoid 
trivialities,  also  assume  that  m > 0. 

The  above  stated  assumptions  guarantee  that  a solution 
satisfying  the  Kuhn-Tucker  optimality  conditions  (KTC)  is  optimal. 
The  KTC  are: 2 


^(x..)  - Xg^x..)  < 0 , 

xi[fi(xi)  " X9i(xi^  = 0 > 


1.  These  conditions  can  be  found  in  most  mathematical 
programming  texts.  The  constraint  qualification  is  not  necessary 
here  in  that  an  interior  point  is  guaranteed. 

2.  The  notation  f'(x)  denotes  the  first  derivative  of  f ( . ) 
evaluated  at  x . 


4 


(7) 


n 

X[m  - E g.(x. )]  = 0 

i=l  1 

X > 0 , (8) 

in  addition  to  Eqs.  2 and  3. 

The  remainder  of  this  section  addresses  the  problem  of  finding 
values  of  X and  x which  satisfy  the  KTC.  These  values  are  first 
characterized  in  three  lemmas  which  culminate  in  a reformulation  of 
the  problem.  An  algorithm  based  on  the  new  problem  is  then  given, 
providing  a method  of  constructing  the  optimal  solution. 

Lemma  1:  If  (X,x)  satisfies  the  KTC,  then  X > 0. 

Proof: 

Suppose  X = 0 . Then  from  Eq.  5,  f?(x_^)  < 0 for  all  i 
which  contradicts  assumption  A2.  Thus,  X > 0.  Q.E.D. 

Define  the  function  as  follows: 


h.(x.  ) = 


gr(Xi) 


for  xd  > 0.  Lemma  2 gives  some  useful  properties  of  this  function. 

Lemma  2:  The  function  h_.(-)  is  positive  and  strictly  decreasing 
on  [0,®].  Hence,  its  inverse  function  h^  (•)  is  uniquely  defined 
and  is  continuous  on  [h^(®),  fw(0)]. 

Proof: 

By  assumption  A2,  ff(-)  and  g^( • ) are  positive,  and 
so  fu(*)  is  positive.  Now  for  x^  > 0 , 


dx. 

l 


'i(Xi)  = 


gf(x.)f:'(x.)  - f!(x.)g:'(x.) 
i i i iJi  i 

[g^)]2 


By  assumptions  A2  and  A3,  the  numerator  is  negative. 
Thus,  h.(-)  is  strictly  decreasing  from  h. (®)  to  h. (0). 


5 


Furthermore  from  assumption  Al,  h.(*)  is  a continuous 
function.  Thus  fu  (y)  exists,  is  unique,  and  is  con- 
tinuous on  [hi(oo),  hi( 0 )]  . Q.E.D. 

Letting  x_^(X)  denote  a solution  to  Eqs.  5 and  6 for  a fixed 
value  of  X , Lemma  3 characterizes  this  solution  as  a function  of 
X.  Theorem  4 follows,  providing  the  main  result  of  this  section. 

Lemma  3 ; Suppose  that  X > bu(co).  Then  the  unique  value  of  x^, 
denoted  x^CX),  which  solves  Eqs.  5 and  6 is  given  by 


x^(X ) 


0 , if  X > h..(0)  , 

h^CX),  if  h.(co)  < X < h.(0)  . 


Proof: 

Note  first  that  f((®)  - Xg((°°)  < 0,  since  X > fuC®). 
If  X > h±(0),  then  letting  x_L(X)  = 0 satisfies  both 
Eqs.  5 and  6.  Furthermore  if  in  this  case  x.(X)  > 0, 
then  Eq.  6 is  not  satisfied.  Hence,  the  unique  value 
of  xi(X)  for  X > h^(0)  is  x^X  ) = 0. 


(9) 


If  h..(®)  < X < hi(0),  then  by  letting  xi(X)  = hT1(X), 
both  Eqs.  5 and  6 are  again  satisfied.  Furthermore 
by  Lemma  2,  the  solution  is  unique.  Q.E.D. 

Theorem  4;  Let  X*  be  the  solution  to  the  following  mathematical 
program: 


minimize  X 


subject  to 


n 

E g,-[x.(X)]<m 

i=l  1 1 


(10) 


where  x^(X)  is  given  by  Eq.  9.  There  exists  a unique  X*  and,  further- 
more, x(X*)  = [x^CX*),  x2(X*),...,  x (X*)]  solves  the  continuous 
problem  given  by  Eqs.  1,  2,  and  3 and  satisfies  Eq.  10  with  equality. 


1 


6 


Proof: 


If  X > max  jlu(O)}  , then  Eq.  10  is  satisfied,  since 
by  Lemma  3,  x^(X)  = 0 for  i = 1,2,...,  n.  Thus,  there 
is  a feasible  solution  to  the  mathematical  program.  From 
Lemmas  2 and  3,  x^X)  is  seen  to  be  a strictly  decreasing 
function  of  X on  [tuC®),  1^(0)].  Thus,  g^x^X)]  is 
also  strictly  decreasing  in  X on  the  same  interval. 

For  X = min  | h^(®)  } , 


£ g.-(x.(X))  = » > m 
i=l  1 1 


Thus,  £ g. [x.(X )]  is  strictly  decreasing  from  ® 
i=l  1 

to  0 as  X increases  from  min  Jh.(®)|  to  max 

i 1 i 

jlu(0)}  . Hence,  there  exists  a unique  X*  such  that 
Eq.  10  is  satisfied  with  equality.  But,  then, 

[X*,  x(X*)]  satisfies  the  KTC,  and  so  x(X*)  solves 

the  continuous  problem.  Q.E.D. 

Theorem  4 provides  the  basis  for  algorithms  to  solve  the 
continuous  problem.  Any  systematic  scheme  for  varying  X until 
Eq.  10  is  satisfied  with  equality  will  suffice.  In  some  cases  an 
analytical  derivation  of  that  X*  may  be  accomplished.  An  example 
is  discussed  in  Section  V. 
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INTEGER  PROBLEM 


The  integer  problem  given  by  Eqs.  1,2,3,  and  4 is  treated  in  this 
section.  The  following  assumptions  are  retained  throughout: 

Bl:  f^( ■ ) and  g^( • ) are  nonnegative  functions  defined 

on  I = | 0, 1, 2, . . . | . Furthermore,  g^( • ) is  integer 

valued; 

B2:  f^( • ) and  g^(-)  are  strictly  increasing  functions;  and 

B3:  fi( • ) is  a strictly  concave  function,  and  gi( • ) is  a 
strictly  convex  function. 

For  completeness  the  well-known  result  characterizing  the 
maximum  of  a concave  function  over  a set  of  integers  is  given 
in  Lemma  5.  Figure  1 illustrates  the  proof. 

Lemma  5:  A concave  function  h(x)  defined  on  I is  maximized 
at  x*,  where ^ 


x*  = 


| 0,  if  Ah(x)  < 0 for  x = 0,1,2,...  , 

x,  if  Ah(x-l)  > 0 > Ah(x)  for  some  x > 1 

®,  if  Ah(x)  > 0 for  x = 0,1,2,... 


Proof: 


If  Ah(x)  < 0 for  all  nonnegative  integers,  then 


h(0)  > h(l)  > h(2)...  , 

and  so  h( •)  is  maximized  at  0 . If  Ah(x)  > 0 for  all 

nonnegative  integers,  then 

h(x+l)  > h(x) 


1.  The  notation  Ah(x)  denotes  the  first  difference  of  h( • ) 

evaluated  at  x;  that  is  Ah(x)  = h(x+l)  - h(x).  Also  A1 2h(x)  = 
Ah( x+1 ) - Ah(x). 
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0 
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for  all  x . Hence  h( • ) is  maximized  at  ® . 

Since  h(x)  is  concave,  Ah(x)  is  a nonincreasing  function; 
that  is  Ah(x)  > Ah(x+1)  for  x = 0,1,2...  . Suppose  that 

it  is  not  true  that  Ah(x)  < 0 for  all  x . Then  there  is 
an  x such  that  Ah(x)  > 0 . If  it  is  also  not  true  that 
Ah(x)  > 0 for  all  x , then  there  is  an  x > 1 such  that 

Ah(x-l)  > 0 > Ah(x) 

It  remains  to  show  that  x maximizes  h( • ) in  this  case. 
Suppose  that  y maximizes  h(.).  For  specificity  suppose 
that  y > x.  Now 

y-x-1 

h(x)  - h(y)  = S [ - Ah(x+k)] 
k=0 

> 0 , 

since  0 > Ah(x)  > Ah(x  + 1)  > ...  . Thus,  x does 

maximize  h(.).  An  analogous  argument  suffices  if 
y < x.  Q.E.D. 


Figure  1.  CONCAVE  INTEGER-VALUED  FUNCTION 
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Consider  now  the  solution  of  the  following  (unconstrained 
Lagrangian)  problem: 


n 


E [Mxj)  - Xg.(x  )] 
i=l  1 1 11 

(ID 

x.^I  , 1=1,2,...,  n , 

(12) 

where  X > 0.  For  fixed  X , let  x(X)  =(x1(X),  x2(X),  ...xn(X)) 
denote  the  solution.  Lemma  6 is  an  analog  to  Lemma  3. 

Lemma  6:  The  solution  of  Eqs.  11  and  12  for  X > 0 is  x(X), 
where 

10  , if  X > Afi(0)/Agi(0) 

V if  Afi(x-1)/Agi(x-1)  > X > Afi(x.)/Agi(xi) 

(13) 

for  some  integer  x^  > 1 

“ , if  Afi(x)Agi(x)  > X all  x , 

for  i=l, 2, . . . , n. 

Proof: 

The  function  given  by  Eq.  11  is  maximized  if  and  only  if 
fi(xi)  - Xg^(x^)  is  maximized  for  each  i . By  assumption 
B3  this  function  is  concave.  The  result  now  follows  from 
Lemma  5.  Q.E.D. 

Lemma  7;  The  function  x^(X)  is  a nonincreasing  function  of  X . 
Proof: 

Suppose  that  X^  > X2  > 0.  Let  h^( • ) = Af^( • )/Ag^( • ) • 

If  h^x)  > X^^  for  all  x , then  h^x)  > X2  for  all  x . 

Thus,  xi(X1)  = « implies  that  xi(X2)  = ®. 

If  X1  > Ah^(0),  then  x^(X1)  = 0 and  so  in  this  case 
xi(X2)  > xi(X1)  . 
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I 


IJ 
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Finally,  suppose  that  h^x^l)  > > h..(x)  for  some 

x±  > 1.  Then  h^x^-l)  > X2  and  so  xi(X2)  >x±  = 

xi(X-L),  which  completes  the  proof.  Q.E.D. 

Theorem  8:  Suppose  that  giC 0 ) = 0.  There  exists  a X*  > 0 
solving 

minimize  X 

subject  to 
n 

E g.-[x.(X)]  < m , (14) 

i=l  11  — 

where  x..(X)  is  given  by  Eq.  13.  If  Eq.  14  is  satisfied  with 
equality,  then  x(X)  is  the  solution  to  Eqs.  1,  2,  3,  and  4. 

Proof; 

By  an  analogous  argument  to  that  given  in  Theorem  4, 
there  does  exist  a X*  solving  the  constrained  minimi- 
zation problem. 

The  proof  is  completed  by  appeal  to  H.  Everett's 
2 

theorem  regarding  the  solution  of  constrained 
optimization  problems.  Q.E.D. 

In  comparing  Theorems  4 and  8 it  is  to  be  noted  that  for  the 
continuous  case  it  is  not  required  that  a value  of  X exist  such 
that  the  analog  of  Eq.  14  holds  with  equality  in  order  to  obtain 
the  optimal  continuous  solution.  Assumption  A2  implies  that 
equality  will  indeed  hold.  That  equality  is  required  in  Eq.  14 
is  not  vacuous  for  the  integer  case.  An  example  will  illustrate 
that  there  are  cases  for  which  the  optimal  solution  to  Eqs.  1,  2, 

3,  and  4 cannot  be  found  by'  the  method  inherent  in  Theorem  8.  In 


i 


2.  H.  Everett,  "Generalized  Lagrange  Multiplier  Method  for 
Solving  Problems  of  Optimal  Allocation  of  Resources,"  Operations 
Research.  II  (1963),  pp. 399-417. 
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the  terminology  of  Everett^,  such  an  example  illustrates  the  existence 
of  gaps.  It  is  interesting  to  note  that  these  gaps  can  occur  even 
in  convex  programming  problems  if  integer  solutions  are  required. 

Suppose  that  n = 2.  The  functional  values  of  f^(.)  and  g^.) 
are  given  in  Table  1.  These  functions  satisfy  assumptions  Bl,  B2, 
and  B3.  Table  2 gives  the  values  of  x^(X)  and  x2(X)  for  selected 

Table  1 

FUNCTION  VALUES  FOR  AN  EXAMPLE 


x f-^x)  g-^x) 


Af1(x)/Ag1(x)  f 2 ( x ) g2(x) 


Af2(x)/Ag2(x) 


0 0 0 

15  1 

2 9 3 


5 0 0 

2 20  2 

38  5 


10 
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values  of  X . It  is  clear  that  the  minimization  of  X subject 
to  Eq.  14  does  not  yield  the  optimal  integer  solution  for  m = 1. 

In  the  special  case  given  by  Corollary  9,  however,  the  minimization 
of  X subject  to  Eq.  14  will  yield  an  optimal  solution  to  Eqs. 

1,  2,  3,  and  4. 


Table  2 

INTEGER  SOLUTION  FOR  AN  EXAMPLE 


xx(X  ) 

X > 10  0 

10  > X > 6 0 

6 > X > 5 0 


x2(X  ; 

0 

1 

2 


91[x1(X)]  + g2[x2(X)j 

0 

2 

5 


3.  Ibid. 
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Corollary  9:  Suppose  that  g^x^  = for  i = 1,2,...,  n.  Then 

if  X*  is  the  smallest  value  of  X subject  to  Eq.  14,  x(X*)  is  the 
optimal  solution  for  the  integer  allocation  problem. 

Proof; 

From  Lemma  7,  xi(X ) increases  as  X decreases.  Thus, 
n 


E x. (X)  also  increases  as  X is  decreased. 
i=l  1 


Noting  from  the 


proof  of  Lemmas  5 and  6 that  if  Afi(xi)/Agi(xi)  = X,  then 
xi(X)  and  x^X)  + 1 both  maximize  fi(xi)  - Xgi(xi),  it 
follows  that  by  decreasing  X to  some  X*,  Eq.  14  can  be 
satisfied  (perhaps  nonuniquely)  with  equality.  By 
Theorem  8,  then,  the  proof  is  complete. 


Q.E.D. 


IV 


RELATIONSHIP  BETWEEN  CONTINUOUS  AND  INTEGER  SOLUTIONS 

In  this  section  results  are  given  which  relate  the  continuous  solu- 
tion to  the  integer  solution.  These  results  have  computational 
importance  in  that  they  provide  the  means  for  applying  simple 
rounding  techniques  to  obtain  the  optimal  integer  solution  from 
the  optimal  continuous  solution. 

The  problem  treated  here  is  that  of  Section  III  where  gi(xi) 

= for  i = 1,  2,...,  n.  The  main  result  is  a characterization 
of  a subclass  of  allocation  problems  with  concave  return  functions 
for  which  the  optimal  continuous  solution  can  be  rounded  up  or 
down  by  at  most  one  to  obtain  the  optimal  integer  solution.  A 
rounding  rule  is  also  derived  in  order  to  specify  which  of  the 
variables  are  to  be  rounded  up  and  which  are  to  rounded  down. 

Theorem  10;  Let  x = (x^  Xg,...,  xn)  be  the  optimal  continuous 
solution  to  Eqs.  1,  2,  and  3,  and  let  x*  = (x*,  x*,...,  x*)  be  the 
optimal  integer  solution  to  Eqs.  1,  2,  3,  and  4.  If1 

x*  = [x.]  or  [x..]  + 1,  for  i = 1,2,...,  n , (IS) 

then  upon  reordering  the  indices  so  that 

Afi([xi]  > Afi+1([xi+13)  , (16) 

for  i = 1,2,...,  n - 1,  the  optimal  integer  solution  is 


1.  For  any  real  number  x , let  [x]  be  the  largest  integer 
_less  than  or  equal  to  x . A number  is  said  to  be  "rounded"  to 
x if  the  value  of  x is  either  [x]  or  [x]  ♦ 1. 
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u 


0 


u 


r 


X*  = 


[xd]  + 1 

CXi]  , 


for  i = 1,  2,  ... . , k , 


for  i = k+1,  k+2, . . . , n , 


(17) 


n 


where  k = m - E [ x . ] . 

i=l  1 


Proof : 


By  the  proof  of  Theorem  4 and  by  assumption,  I x.  = m. 

* T 1 


Thus, 


1=1 


n _ n 

£ [x. J < m < n + E [x.J 

i=l  i=l  1 


Furthermore,  k = m - E [x]  is  an  integer  and  0 < k < n. 

i=l 


By  hypothesis  (Eq.  15)  the  optimal  integer  solution  can  be 
obtained  by  rounding  up  and/or  down  at  most  one  from  the 
optimal  continuous  solution.  By  Corollary  9 the  optimal 

n 


integer  solution  satisfies  E x?  = m.  Thus,  exactly  k 

i=l 


of  the  continuous  variables  must  be  rounded  up  and  n-k 
rounded  down.  To  complete  the  proof  it  is  shown  that 
those  variables  which  are  rounded  up  are  given  by  the  k 
variables  for  which  the  difference  of  f^([‘x^])  is  largest. 

Suppose  that  there  is  an  optimal  allocation  y = 
yn)  such  that  y^  = [x^]  + 1 and  y_.  = [x_.  ] , where 


AfjCtXj])  > AfR([xk]) 


Compare  this  solution  with  the  one  where  y*  = y except 
that  y£  = [x^]  and  y^  = [x^]  + 1.  The  difference  in 


the  maximands  for  y and  y*  is 
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fjCCXj]  + l)  + fk([xk])  - - fk([\]  + 

= Af  j ( [Xj  ] ) - Afk([\]) 


Thus,  the  allocation  y*  has  a higher  return  than 

the  allocation  y , which  contradicts  the  optimality 

of  y . Q.E.D. 

In  order  to  make  computational  use  of  Theorem  10,  it  is  necessary 
to  know  that  Eq.  15  holds.  A natural  question  to  ask  is  when  can  one 
be  assured  that  a rounding  procedure  is  indeed  optimal.  Theorem  11 
below  gives  a sufficient  condition  for  Eq.  15  to  hold.  The  condition 
is  a strong  one  in  the  sense  that  the  set  of  objective  functions 
satisfying  it  is  relatively  small.  However,  for  some  applications 
of  interest  the  condition  can  be  shown  to  hold.  Examples  of  these 
applications  are  given  in  detail  in  Section  V.  Theorem  12  provides 
an  equivalent  condition  to  that  of  Theorem  11.  These  conditions  in 
effect  demand  that  the  return  functions  for  each  of  the  n alterna- 
tives be  two  dimensional  translates  of  each  other. 

Theorem  11;  For  x^(X)  given  by  Eq.  9,  suppose  that 

f-(x.(X)  + 6)  = fjCXjU)  + 6) 

for  all  6 > - min  (x^(\),  x^.(\))  when  x^(\)  > 0 and  x^(X.)  > 0.  Let 
x(D  be  the  optimal  (continuous)  solution  to  Eqs.  1,  2,  and  3,  and 
let  x*  be  the  optimal  (integer)  solution  to  Eqs.  1,  2,  3,  and  4. 
Reorder  the  indices  so  that  the  fractional  parts  of  the  continuous 
solution  satisfy  r1  > > . . . > r^,  where 

[x.(D]  + v±  = x^X.)  . 


I 


Then,  there  is  a k,l<k<n,  such  that 


l 


U 


[1 

n 

0 


r 


! 


0 

r 


['xi CT ) ] + 1 , for  1=1,2,...,  k 

[x^D]  , for  i=k+l,  k+2, . . . , n . 

Proof: 

Let  x*(X)  be  the  solution  to  Eqs.  11  and  12  for  X = T. 
Since  x(T)  is  optimal,  by  Lemma  3 

X = f '(x.(D)  , i=l,  2, . . . , n . 

Hence,  by  the  concavity  of  f ^( • ) , 

Afi([x.(X)]  + 1)  < X < Afi([xi(X')]  - 1)  . 

Thus,  by  Lemma  6 x?  (T)  = fx^(T)]  or  [x^T)]  + 1. 
n 

Now  if  £ xt(X)  = m,  then  x*(X)  is  the  optimal  integer 

i=l  1 1 

solution.  In  general  this  equality  will  not  hold.  For 

n 

specificity  suppose  that  £ x?(\)  > m.  The  remaining 

i=l  1 

case  is  treated  analogously  and  is  omitted. 

By  Theorem  8 and  Corollary  9,  increasing  X to  some 
X*  gives  an  optimal  integer  solution  x*(X*).  By  Lemma  7, 
x*(X)  is  decreasing  in  X . Thus, 

x*(X*)  < x*(X)  , i=l,  2, . . . , n . 

The  proof  is  completed  by  contradiction.  Suppose  that 

x*(X ) = [x^D]  - 1 > 0 

for  some  i where  i is  a positive  integer.  Then  there 
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t 


must  also  exist  at  least  one  index  j for  which 
xJ(X*)  = [x.(X)]  + 1 , 

for  if  not,  then 

n n _ _ n 

£ x*(X*)  < E [x  (X)]  < £ x.(X)  = m 

i=l  3 i=l  3 i=l  3 

which  is  nonoptimal  for  the  integer  problem.  From  the 
conditions  for  integer  optimality  (Lemma  6), 

Af.([x.(X)]  - SL  - 1)  > X*  > Af^Cx.d)]  - i)  , (18) 

and 

Af j ( [x^ (T )]) > X*  > Afj( fXj(D]  + 1)  . (19) 

It  is  now  shown  that 

Afi([xi(X)]  - 1)  > Af..([x  (D])  (20) 

for  all  i and  j which  will  contradict  Eq.  18  and 
Eq.  19,  since  then 

X*  > Afi([x.(D]  - A)  > Af.([x.(X)]  - 1) 

> Af^Cx^X)]  > X*  . 

By  the  fundamental  theorem  of  calculus 


J f:(xi  + t)dt  = f ^ ( x^ ) - fi(xi  - 1) 


-1 


By  hypothesis,  then 


J * fi(x.(X)  + t)dt  = / fj(Xj(X)  + t)dt 
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or 


0 

0 

D 

0 


fi(xi(X))  - fi(xi(I)  - 1)  = f.(y  T))  - fjCx^x)  - 1) 
By  the  concavity  of  f^( • ) and  fj(*)  j 

Af^rx.CX)]  - 1)  > fi(xi(D)  - fi(xi(D  - 1) 


= fj(Xj(X))  - fjCx^d)  - 1) 


> AfjCCx^X)])  , 

establishing  Eq.  19. 

To  complete  the  proof  it  suffices,  by  appeal  to 
Theorem  10,  to  show  that  r^  > r^  implies  that 

Af.CCx^I)])  > Af^Cx.d)])  . 

If  r^  > r j , then  the  concavity  of  f^(*)  implies  that 


fj(Xj(\)  - r..  + t)  < f.J(x..(X)  - ri  + t) 


for  all  t > r.  - x.(X).  Hence, 
— l 3 


Af^cx-d)])  - AfjCtXjd)]) 


(X)]  + t)  - fj([Xj(X)]  + t)  dt 


J f^Cx^X)  - r±  + t)  - fj(x.j(X)  - r^  + t) 

o L J 


dt 
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s 


= 0 • Q.E.D. 

Theorem  12:  There  exist  constants  (ot^,  3i),  when  x > 0,  such 
that  for  some  j and  all  i 

fi(x  + a±)  + 0i  = fj(x) 

if  and  only  if 

fr(xia)  + 6)  = frcxjCx)  + 6) 

for  all  6 > 0 where  x.(X)  > 0 and  x-(X)  > 0 . 

™ r J. 

Proof; 

By  the  definition  of  x^(X)  , 

f-r(x.a))  = fj'cxjtt))  = x 

for  x±(X)  > 0 and  x..(X)  > 0.  Thus,  f^x^X)  + 5)  = 
fj(Xj(X)  +6)  for  all  6 > 0 is  equivalent  to 

f (x  (X)  + 6)  - f . (x.  (X  ))  = f.(x.(X)  + 6)  - f • (x . (X  ) ) 

-L“L  ± ± JJ  JJ 

for  all  6 > 0.  Letting  cu  = x^CX)  - x^(X)  and 
0±  = fjCXjCX))  - fi(xi(X)),  we  have 

fi(xj(X)  + 6 + a±)  + ^ = f j(Xj(X ) + 6) 

which  completes  the  proof.  Q.E.D. 


V 


EXAMPLES 


In  this  section  examples  are  given  of  the  types  of  problems  amenable 
to  the  analysis  presented  in  the  first  four  sections.  Particular 
attention  is  paid  to  a problem  which  is  commonly  encountered  in 
military  systems  analysis.  The  section  concludes  with  a listing  of 
some  objective  functions  which  meet  the  condition  of  Theorem  11 
(and,  consequently,  Theorem  12). 

We  consider  first  the  problem  of  finding  a nonnegative  integer 


allocation 


so  as  to 


n x. 

maximize  £ v.[l  - p.  1 
i=l  1 1 


subject  to 


£ x.  < m . 
i=l  1 


This  problem  is  familiar  to  many  military  analysts,  particularly 
those  for  whom  analysis  of  strategic  systems  is  of  concern.  A prota- 
gonist has  an  inventory  of  m identical  weapons  which  are  to  be 
targeted  on  some  subset  of  n available  targets.  For  each  target 
there  is  a probability  of  p^,  0 < p.  <1,  that  it  survives  a shot 
from  one  weapon.  It  is  assumed  then  that  1 - p*i  is  the  probability 
that  the  target  is  destroyed  if  x^  weapons  are  targeted  on  it.  The 
parameter  v^  is  a measure  of  the  value  of  target  i . The  objective 
is  to  maximize  the  expected  value  of  the  targets  destroyed  by  m 
weapons.  A discussion  of  such  problems  can  be  found  in  a recent 
paper  by  W.  J.  Schultis.1 


1.  W.  J.  Schultis,  A Manual  Model  for  Strategic  Conflict 
Analysis , IDA  Research  Paper  P-493  (July  1969),  pp.  15-20. 
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A model  drawn  from  reliability  theory  also  can  be  represented 

by  Eqs.  21  and  22.  Suppose  there  are  n production  lines.  If 

line  i operates  without  fail  for  a specified  length  of  time,  say 

T , then  a return  of  vi  is  realized.  A line  fails  before  time  T 

if  some  subsystem  of  that  line  fails  before  time  T . Suppose  that 

p^(T)  is  the  probability  that  the  subsystem  in  production  line  i 

survives  until  time  T . If  parallel  redundancy  is  allowed  then 
xi 

1 - [pi(T)]  is  the  probability  that  production  line  i survives 
until  time  T when  x^.  parallel  subsystems  are  used.  Again  the 
objective  is  to  maximize  the  expected  return  from  the  use  of  m 
subsystems. 

Assuming  that  v.^  > 0 and  0 < pi  < 1,  for  i =1,2,...,  n,  the 
objective  function  given  in  Eq.  21  is  strictly  increasing  and 
strictly  concave.  Applying  Lemma  3,  it  is  found  that  for  X > 0, 


x.(X) 


[■  in(-X/vixnpi)'|  + 

L J ’ 


(23) 


where  x+  = max  (0,  x).  Using  the  fact  that  E x.(\)  = m,  the 

i=l  1 

variable  \ can  be  eliminated  to  find  the  continuous  solution  to 

2 

Eqs.  21  and  22.  Lemus  and  David  use  Eq.  23  in  conjunction  with 
some  heuristic  rounding  procedures  to  obtain  an  integer  solution 
to  the  problem.  In  a recent  IDA  paper  C.  L.  Dym  and  R.  E.  Schwartz^ 
provide  a means  of  computing  the  optimal  integer  solution  based  on 
the  optimal  continuous  solution  for  the  special  case  where  p^  = p for 
i = 1,  2,...,  n.  In  the  terminology  of  Section  IV  they  show  that 


2.  F.  Lemus  and  K.  H.  David,  "An  Optimum  Allocation  of 
Different  Weapons  to  a Target  Complex,"  Operations  Research, 
II  (1963),  pp.  787-794. 

3.  C.  L.  Dym  and  R.  E.  Schwartz,  Optimum  Pre- Attack 
Targeting,  IDA  Research  Paper  P-546  (October  1969). 


s 
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the  optimal  integer  solution  is  attainable  from  the  optimal  continuous 
solution  by  a rounding  procedure  based  on  the  fractional  part  of  the 
continuous  solution. 

To  demonstrate  the  use  of  Theorems  10,  11,  and  12  it  is  now  shown 
that  the  Dym/Schwartz  result:  can  be  obtained  from  the  more  general 
theory  of  Section  IV. 


A . 

Now  r^(x^)  = [1  - P^1]  and  so 


fi(xi^  = ' • 


Then  by  using  Eq.  23, 


j&n(-X/v.£np.  )/£np.+€ 
f-(x.U)  + €)  = - v.Unp.)?. 


for  xi(\)  > 0.  Simplifying, 


fi(xi(X)  - €)  = -v.»np.)  • Pi 


Thus,  it  is  seen  that  if  p^  h p,  f?(x^(X)  + €)  = fj(x^.(X)  + €). 
Hence,  the  hypotheses  of  Theorem  11  hold,  and  the  optimal  integer 
solution  is  readily  found  from  the  continuous  solution  by  comparing 
the  fractional  parts  of  the  variables. 

In  contrast  to  developing  a rounding  procedure,  the  optimal 
integer  solution  can  be  found  directly  by  using  the  results  given 
in  Section  III.  Let 


Then 


h^(x)  = Afi(x)  , i = 1,2,...,  n 


hi(x)  = vi(l  - p^p* 
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An  algorithm  which  yields  an  optimal  integer  solution  follows: 

Step  1.  Compute  h^(x)  and  order  these  values  in  a decreasing 

sequence,  say  k^  > k2  > ...  . Take  X = max  jh^x)}  = k..  Set 

1 , x 

r = 1.  Set  i = 1. 

Step  2.  Replace  i by  i + 1.  Replace  r by  r + 1.  If 
r < m,  then  repeat  Step  2.  If  r = m go  to  Step  3. 

Step  3.  Recover  the  optimal  allocation  by  letting  x^  be  the 
largest  value  of  x for  which  h^x)  is  included  in  the  set 

Jkl>  k2>  kml  * 

The  proof  of  the  algorithm  is  based  on  Corollary  9 and  is  not 
given  here. 

Examples  of  three  other  functional  forms  which  satisfy  the  con- 
ditions of  Theorem  11  are  now  given.  First  consider 

f.(x)  = ai(l  - b.cx) 

where  a i >0,  b^  > 0,  and  0 < c < 1.  Note  that  this  function 
encompasses  as  a special  case  the  one  considered  previously  as  well 
as  the  function  a^l  - e"cx).  By  considering  derivatives,  f^Cx)  is 
easily  shown  to  be  nondecreasing  and  concave.  In  fact 

vf'(x)  = - a.b.Un  c)cx  , 

and  so 


xi(X)  = 


- appro] 


and  f^Cx^X)  + 6)  = X c^  which  is  independent  of  i . 


As  another  example  consider 


fA(x)  = a in(b^  - c±d  ) , 


* -« 


where  a > 0,  b^  > c^  > 0,  and  0 < d < 1.  Again  f^(x)  can  be  shown  to 
be  nondecreasing  and  concave.  Furthermore, 


so  that 


in[^c.  - ac.  in  d^ 

x.(\)  = i i 

in  d 


ff(x  (X)  + €)  = d?d 

\ - a (in  d)  - \de 


which  is  independent  of  i . 

Finally  suppose  that 

fi(x)  = a in(b^  + c^x)  , 

where  a > 0,  b^  > 0,  and  c^  > 0.  Then  f^(x)  is  nondecreasing  and 
concave  and 


It  is  easily  shown  that 


ac . 

f • <*)  = t 42c  x ‘ 
i i 


- ■ per  • 


and  that 


which  is  independent  of  i . 
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